Generalized Thresholding Sparsity-Aware Online Learning in a Union of Subspaces
نویسندگان
چکیده
This paper studies a non-convexly constrained, sparse inverse problem in time-varying environments from a set theoretic estimation perspective. A new theory is developed that allows for the incorporation, in a unifying way, of different thresholding rules to promote sparsity, that may be even related to non-convex penalty functions. The resulted generalized thresholding operator is embodied in an efficient online, sparsity-aware learning scheme. The algorithm is of low computational complexity exhibiting a linear dependence on the number of free parameters. A convergence analysis of the proposed algorithm is conducted, and extensive experiments are also exhibited in order to validate the novel methodology. Index Terms Inverse problems, sparsity, non-convex, partially quasi-nonexpansive mappings, online signal recovery.
منابع مشابه
Generalized Iterative Thresholding for Sparsity-Aware Online Volterra System Identification
The present paper explores the link between thresholding, one of the key enablers in sparsity-promoting algorithms, and Volterra system identification in the context of time-adaptive or online learning. A connection is established between the recently developed generalized thresholding operator and optimization theory via the concept of proximal mappings which are associated with non-convex pen...
متن کاملRobust Subspace Recovery via Bi-Sparsity Pursuit
Successful applications of sparse models in computer vision and machine learning [3][2][5] imply that in many real-world applications, high dimensional data is distributed in a union of low dimensional subspaces. Nevertheless, the underlying structure may be affected by sparse errors and/or outliers. In this paper, we propose a dual sparse model as a framework to analyze this problem and provid...
متن کاملA Tight Bound of Hard Thresholding
This1 paper is concerned with the hard thresholding technique which sets all but the k largest absolute elements to zero. We establish a tight bound that quantitatively characterizes the deviation of the thresholded solution from a given signal. Our theoretical result is universal in the sense that it holds for all choices of parameters, and the underlying analysis only depends on fundamental a...
متن کاملBlock-Based Compressive Sensing Using Soft Thresholding of Adaptive Transform Coefficients
Compressive sampling (CS) is a new technique for simultaneous sampling and compression of signals in which the sampling rate can be very small under certain conditions. Due to the limited number of samples, image reconstruction based on CS samples is a challenging task. Most of the existing CS image reconstruction methods have a high computational complexity as they are applied on the entire im...
متن کاملACCURATE PREDICTION OF PHASE TRANSITIONS IN COMPRESSED SENSING VIA A CONNECTION TO MINIMAX DENOISING By
Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula precisely delineating the allowable degree of of undersampling of generalized sparse objects. The formula applies to Approximate Message Passing (AMP) algorithms for ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1112.0665 شماره
صفحات -
تاریخ انتشار 2011